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ABSTRACT 

The Delphic Technique utilizes a surrey format with 
Bultiple rounds of questionnaires, sequential statistical feedback, 
and respondent anonymity. The principal objective is to use expert 
opinion to refine predictions about the occurrence of future events. 
An open-ended questionnaire vas sent to 200 subjects selected froi 
the ■enbership of the Association for Educational Coiaunications and 
Technology. They were asked to identify the trends in educational 
media and technology they felt would be significant in the next 25 
years. Four rounds of questionnaires vere generated and analyzed. 
Froi the results it is difficult to derive substantive inforiation 
concerning the future of educational nedia and technology. Opinion 
converged tovard the view that hardware trends are lore likely to 
occur, and software trends are lore inportant. The technique and the 
results obtained had lany limitations which were noted. (CH) 
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A Delphtc Exploration of the Future of 
Educatlona I Media 

What do you think about when you hear the words "prediction" or 
"forecast"? Perhaps the weather? The weatherman has a pretty good 
record for short-term prediction; there Is a great deal of past 
experience to work with, and weather patterns can be traced across 
the country. Most other common forms of prediction have not developed 
the track record that Is required for confidence among natural skep- 
tics. I am a skeptic too! There has been a recent awakening of 
Interest In "technological forecasting", predicting the trends In 
technological development In the short and long-term future. The 
science Is still much too young for us to point out any really 
substantive evidence of success. Forecasting has remained a marginal 
science at best, and It Is still an activity which most scientists 
tend to tolerate with a jaundiced eye. 

Most techno 1 og t ca I forecast I ng has deve loped since I960, and 
has been utilized almost entirely by business and governmetst Interests. 
Most often businesses follow the philosophy, "Why not try It; It can 
only help us." It has been this healthy venturesomeness In the 
business community that has assured their success. Nothing ventured, 
nothing gained! In education, our philosophy has been somewhat 
different. Education Is among the most conservative areas of human 
endeavor. Innovations have spread, but usually slowly and as part 
of a "bandwagon effect". Rarely, If ever, have educators been the 
change agents In our society. More often than not. It has been the 
business community that has dictated the course of educational 
t nnovatlons. 
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The thesis of this paper Is that educators, and particularly 
educational technologists, must begin taking a more direct responsi- 
bility for their own future* As long as technological development 
continues to be haphazard and makeshift, there can be no hope for 
solving some of the key problems In education. There are currently 
a few pockets of experimentation with educational futures and futures 
methodology, but little of this concern has spread to the educational 
mainstream. This paper will briefly describe one attempt at experi- 
menting with the Delphi Technique In forecasting future developments 
In educational media and technology. 

The Delphi Technique, developed by resaarchers at the Rand 
Corporation, utilizes a survey format with multiple rounds, sequen- 
tial statistical feedback, and respondent anonymity. The principal 
objective of the technique Is to use expert opinion to refine pre- 
dictions about the occurrence of future events. It Is assumed that 
the multiple round format will give experts an opportunity to rethink 
their forecasts on the basis of statistical feedback from other 
experts. The use of the survey format, with anonymity assured, was 
proposed to eliminate the potential negative effects of face-to-face 
group deliberation. Including the effects of group-related artifacts 
such as differential status and face saving. The Delphi allows 
experts to deliberate Independently without the contaminating effects 
of ''group dynamics". This technique has been used extensively In 
technological forecasting for approximately a decade, however Its 
most frequent use as a long-term forecasting tool still precludes 
substantive evidence of efficacy. 
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Procedures 

This study used a procedure common to Delphi studies. An open- 
ended questionnaire was sent to two hundred prospective respondents, 
selected by stratified random sampling (for geographical representa- 
tion) from the membership directory of the Association for Educational 
Communications and Technology. Those contacted were asked to 
"nominate" the trends In the field of educational media and technology 
which they felt would be the most significant In the next twenty-five 
years. Return of the first round questionnaire was assumed to 
Indicate agreement to participate In subsequent rounds of the survey. 

One hundred first round questionnaires were returned* Responses 
were content-analyzed In order to determine unique trends which would 
form the basis of subsequent rounds of the survey* Sixty-eight trends 
were enumerated. These were sent back to respondents who were asked 
to rcte each trend for [mportance , pred Icted I ncrease , and the 
certainty of their prediction * This Information was analyzed and 
mean scores were computed. The mean scores were sent back to 
respondents along with the second round of the survey* Due to some 
misunderstandings with the response categories used In the first 
round, categories were revised slightly to Importance and probab I I I ty 
of occurrence . The original three response categories for each Item 
proved confusing and the "certainty of prediction" category, which 
was Intended to weight respondent's se 1 f -perce I ved expertise, did not 
seem to communicate as Intended* Respondents rated each trend on a 
five-point LIkert-type scale, with "I" representing "high" and "5" 
representing "low". In terms of Importance and probability of occur- 
rence* In the third round, trends were further consolidated Into 
ftfty-Isx Items in order to eliminate remaining ambiguities. 
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Third round responses were received and mean scores were again 
computed* These mean scores were sent back to respondents along with 
the fourth and final round of the survey. Respondents were also asked 
to comment upon the survey and make suggestions for future use of the 
Delphi Instrument. The same questionnaire was used for the forc'rr?i 
round as had been used In the th'rd round. The results of the survey 
were then tabulated and a flna! report was written and returned to 
all survey parti cl pants. 

These procedures differed from the standard Delphi model In 
several ways. First, the questions asked were unusual for Delphi 
studies. Usually, respondents are asked to predict a certain year of 
technological Innovation or a specific cost estimate. Although this 
type of question Is probably b«tf«f dosfgnod for the DeJphI procedure^ 
It dM f»wi aoem like the typo of question that would be most benefi- 
cial In these early stages of methodological study. Second, mean 
scores were used Instead of medians for statistical feedback, due to 
their appropriateness for the type of data requested from respondents. 
I nter-quartl le ranges are usually also computed, but were deemed 
Inappropriate feedback In this study (varlancos were used In the 
fhial report to Indicate convergence of opinions). Finally, addl- 
tlonal feedback, such as reasons for extreme positions, was omitted 
In this study, due to time constraints and anticipated confusion. In 
the future a more orthodox study might prove helpful by way of 
comparl son. 
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Resu Its 

The results of this study are difficult to Interpret In terms of 
neat and. cl ear-cut genera I I zat Ions. Obviously, as can be seen from 
the accompanying tables, different Items seem to react differently 
through the course of the survey. As a result. It Is difficult to 
derive substantive Information concerning the future of educational 
media and technology. What we can see Is a convergence of opfnion 
for most Items, as demonstrated by the narrowing of the response 
variance. What we can deduce from\thls Information Is that the Delphi 
seems to be doing what It Is supposed to do, In general, "software" 
and "process" trends appear to be more volatile from round to round 
than "hardware" trends. In addition, "software" trends appear to be 
viewed as more Important. Conversely, "hardware" trends appear to be 
considered by respondents as more likely to occur. The main limita- 
tion of this study seems to be the difficulty In Interpreting the 
response scales as provided* For example, what does a mean score of 
"2.05" really mean? Obviously, In the future, more care must be 
taken In developing questions are scales that will be more easily 
I nterpreted. 



Characteristics of Respondents 
Geograph I cal Distribution: 



Northeast 
Midwest 
South 
West 



27 
24 
18 
31 

100 



Occupational Distribution: 

College & university faculty 27 

Higher education media centers 35 

Schoo I med I a centers 17 

Government 3 

Research centers 3 

Pr I vate enterpr 1 se 10 
Higher education administrator s 5 

100 
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Some Possible Limitations of this Study 

It Is virtually Impossible to specify all the factors that have 
Imposed limitations on this study. However, It Is perhaps the most 
valuable outcome of any exploratory Investigation to view the faulty 
assumptions and errors, the correction of which might facilitate 
subsequent efforts. The following are some of the major limitations 
which might have acted upon this study, most of which are stated as 
research questions: 

1, How can one Isolate specific trends In Educational Media 
from the other societal trends that might give rise to 
them and constrain them? 

2, Can we expect reliable results when most respondents have 
had little experience In thinking systematically about 
the long-term future? 

3, Can we expect educators to think about the future when 
there seems to be so little control possible over events? 

4, Educators probably are, on the average, quite conserva- 
tive In their approach to the unknown, 

5, This survey stretched over a period of more than six months, 
which could have had a profound effect on responses, 

6, Was lack of Interest and respondent mortality over time a 
significant factor In this study? 

7, Are we prone to think of the future In a un I d Imens I ona 1 
and undynamic way? 

8, The Delphi Technique has been most effective for specific 
predictions, such as cost and diffusion time of Innova- 
tions, Is general prediction a valid use of the technique? 

9, Should respondents have had previous experience with the 
technique and more explicit understanding of the process? 

10, How serious was the problem of differential Interpretation 
of trends and response categor I es? 

11, Is there a danger In using techniques tike the Oelph! 
before we fully understand their value for education? 

12, Should respondents have had more opportunity to comment 
during the process and add, subtract, and ammend question- 
naire I tems? 

o 
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\5. As unpaid volunteer respondents, how much time was 

actuaMy spent In considering and reviewing responses? 

• 14, Should there have been some differential weighting system 
tn order to consider the Individual strengths and weak- 
nesses of respondents? 

\5. Is there really an audience for such predictive activities 
today? 

\6. Can we expect respondents to predict software developments 
as easily as hardware developments? 

17. Should we not think of the ramifications of these trends 
as we II ? 



Representative Comments and Suggestions by Respondents 

!• Some terms were ambiguous and too general. A number of 
terms, e.g. ho I ography , xou I d have benefited from 
definition and explanation. 

2. Many Items are Interrelated and yet treated as being 
discrete trends. 

3. Many Items seem to overlap. 

4. Some Items are prerequisite to responses to other Items, 
e.g. teacher education. 

5. Some Items depend on external forces which are difficult 
or Impossible to predict, e.g. government actions. 

6. There was a problv^m of reconciling one's own feelings 
- with the feelings of the majority, as the technique 

requires. 

7. There was a probable lack of consistency In considerations 
that Influence responses, such as "coi5t," "feasibility,*' etc* 

8. There were too many rounds to the survey, and Interest 
tended to wane. 

9. Items should have been grouped Into categories of simitar 
types throughout the survey. 

10. What Is the survey measuring? Attitudes? 

11. There Is the problem of differential experience while the 
survey Is In progress. 

I2« There should be encouragement for respondents to use the 
full range of responses. 

13. There Is the problem of "response sets." 

Er|c 9 
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14. Does It matter that different respondents Interpret Items 
differently? 

15. Some questions seemed biased. 

16. Why not ask which trends are most '^unimportant" and 
"Improbable"? 

17. There was a genera! feeling that respondents lacked 
expertise as authorities and as futurists. 

18. When respondents rated the Importance as high and the 
probability as low, there should be supplementary comments. 

19. In any case, there should be a column for additional 
comments for each Item. 

20. There Is the difficulty of quantifying according to the 
response categories. 

Conclusions 

The value of prediction Is probably subject to little doubt. 
Doubt arises from the effectiveness of the technique, procedures, 
and personnel employed. In education this Is a particularly diffi- 
cult problem, for there Is a lack of venturesomeness, a "present 
orientation", and the lack of proven methodologies for attacking the 
problem. There Is a long way to go before we will be able to have 
confidence In thinking about the future; but. It Is time to start 
thinking about It. Although many view surveys as a nuisance, they 
can be a valuable and relatively Inexpensive way to go, especially 
If we learn from the experiences and mistakes of others. 

Before we can have confidence In prediction, the following steps 
will probably be required: 

1. "Future thinking" will have to be taught and accepted as 
being legitimate as past and present thinking. 

2. There should be greater understanding of the Interrelated- 
ness of social processes and methods for assessing the prob- 
able effects of social changes on other related Institutions. 

3. There should be a development of methods for planning future 
events In education and the power to carry them out. 

10 



9 

4» There should be money available to pay consultants to think 
about the future In their areas of expertise. 

5. There should be cooperation between organizations and Indus- 
tries Involved In educational futures. 

6. We must not limit our thinking to hardware and observables 
on I y. 

7. Techniques must be developed for future thinking which have 
the confidence of all concerned. 

8. There should be regular conferences aimed at exploring the 
nature and soc I a I ^ram I f I cat I ons of educational change. 

9. There should be a recognition that educational planning 
Is social ly desi rable. 

10. We shold develop dynamic, not static, models and methods of 
prediction. 

II* There Is a need for collaborative research and Investigation 
among educators and other social scientists. 

^ Hopefully the present study has* provided a valuable preliminary 
step In our Investigations of our educational future. Certainly It 
Is flawed. Probably the year 2000 will bring us far more than Just 
the continuation of current trends or their demise. The major 
question seems to be whether we can choose the educational media and 
technologies that are optimal and plan for them. There Is little 
doubt that such thinking wll! require a different peTspectlve than we 
currently use. 

This current study may be more valuable In exposing our myopia 
than In providing a reliable view of educational futures. It also may 
provide us with a list of priorities and Important research questions. 
If there Is a substantive value to the data. It Is probably the rank- 
ing of the trends according to respondents' perceptions of their 
relative Importance. This might help us focus In on specific areas of 
Investigation with more confidence." Such futures studies are still 
more Important as a process than as a product. The future can be our 
friend or worst enemy, depending on how we view It and on how well 

Q we can plan. In education with our continually shrinking resources, 

kta planning for the future Is a necessity. 11 
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